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ON  THE  POWER  FUNCTION  OF  THE  "BEST"  t-TEST  SOLUTION  OF  THE  BEHRENS-FISH ER  PROBLEM 
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( 

1.  Introduction*  The  Behrens-Fiaher  problem  is  concerned  with  significance  testa  for 

the  difference  of  the  me&na  of  two  normal  populations  when  the  ratio  of  the  variances  of  the 

populations  is  unknown.  Denote  one  population  by  N(a^,  o~^)  and  the  other  by  »(a2,  <r^),  where 

the  notation  N(a,  d~^)  represents  a  normal  population  with  mean  a  and  variance  <r^ .  Let  m 

2  2 

sample  values  be  drawn  from  N(a^,  d~^)  and  n  sample  values  from  N(a2,  d“2)  where  *  ^  n.  Then 
Scheffe  [l]  has  shown  that  certain  optimum  properties  are  possessed  by  a  t-test  solution  he 
proposed  for  the  Behrens-Fisher  problem,  in  which  the  numerator  of  t  is  based  on  the 
difference  of  the  means  of  the  samples  while  the  denominator  is  based  on  the  square  root  of 
a  function  of  the  sample  values  which  has  a  X^-diatribution  with  m-1  degrees  of  freedom. 

The  purpose  of  this  note  is  to  compare  the  power  function  of  this  t-teat  with  the  power 
function  of  the  corresponding  most  powerful  test  for  the  case  in  which  the  ratio  of  variances 
o^/o^  is  also  known  (only  one-sided  and  symmetrical  tests  are  considered).  This  comparison 
is  made  by  computing  the  power  efficiency  (see  section  2  for  definition)  of  Scheffer's  test. 

It  is  sufficient  to  limit  power  efficiency  investigations  to  one-sided  tests.  As  shown 
in  [2],  a  symmetrical  t-test  with  significance  level  2a  has  the  same  power  efficiency  as  the 
corresponding  one-sided  t-test  with  significance  level  a.  Equation  (2)  of  section  2  fumiehee 
an  explicit  formula  whereby  approximate  power  efficiencies  can  be  computed  for  a  wide  range  of 
values  of  a,  m,  n.  Table  1  contains  values  of  (2)  for  a  -  .05,  .01  and  several  values  of  m  and 


For  the  situation  considered  here,  a  power  efficiency  of  100r£  has  the  quantitative 
interpretation  that  the  given  test  based  on  samples  of  size  m  and  n  has  approximately  the  same 
power  function  as  the  corresponding  most  powerful  test  based  on  samples  of  size  m  and  m. 
Intuitively  the  power  efficiency  of  a  test  measures  the  percentage  of  available  information 
per  observation  which  is  utilized  by  that  test. 

2.  Power  efficiency  derivation!.  The  basic  notion  of  the  power  efficiency  of  a 
significance  teat  is  given  in  [2J.  For  the  present  case  the  /problem  is  to  determine  the 
value  r  such  that  a  most  powerful  test  of  the  same  hypothesis  (same  significance  level) 
based  on  rm  and  m  sample  values  will  have  approximately  the  same  power  function  as  the 
given  t-test  based  on  m  and  n  sample  values  ^from  N(a^,  0"^)  and  N(a2,o~2)  respectivelyj. 

Here  the  value  of  <T^/o^  is  assumed  to  be  known.  Then 'the  power  efficiency  of  the  given 
t-test  equals  lOOrjC. 

If  the  ratio  ef  variances  a  is  known,  the  most  powerful  significance  test  (one-eided 
and  symmetrical)  for  the  difference  of  means  of  the  two  normal  populations  ie  a  t-test  where 
the  maerator  of  t  la  based  on  the  difference  of  the  two  sample  means  while  the  denoainater 
ie  based  on  the  square  root  of  a  function  of  the  sample  values  tad  which  has  a  X^- 

distribution  with  m+n-2  degrees  of  freedom  [l,  p.  43].  Thus  the  problem  ie  that  of  comparing 
the  power  functions  of  two  t-tests. 


P-80,  Rev.  6/20/49  -2- 

As  at  at  ad  in  taction  1,  it  ia  sufficient  to  consider  one-sided  tests.  Wa  find,  using 
a  modification  of  tha  normal  approximation  to  tha  power  function  of  a  ona-aidad  t-test  given 
in  [3],  that  Scheffe*a  ona-aidad  t-taat  far  tha  Bthrana-*'iahar  problem  and  tha  corraaponding 
moat  powerful  ona-aidad  taat  Rnown)  have  approximately  tha  aama  powar  function  whan  r 

is  choaan  ao  that 


«„  -  SVr  {l  -  t^/2  0;.  .  n)r  -  2]}1/2  -  ^  -  S[l  -  K^/2(»  -  1)] 

whara  a  ia  tha  aignificanca  level  of  tha  taata,  ia  tha  value  of  tha  standardised  normalised 

deviate  axcaadad  with  probability  a,  and  <5  ia  a  function  of  m,  n,  a^,  a^,  C^,  and  the  given 
hypothetical  valua  of  a^-^  tested.  This  condition  for  tha  approximate  equality  of  tha 

powar  functions  ia  reasonably  accurate  for  tha  fallowing  caseat  a  •  .05,  m  £  4;  a  ■  .025, 
a  >  5;  a  ■  .01,  m  >  6;  a  ■  .005,  m  >  7.  The  accuracy  of  the  approximation  increases  as  m 
increases. 

Hence  a  valua  of  r  such  that  tha  two  power  functions  are  approximately  equal  is  determined 
by  tha  aquation 


.1/2 


(1) 

Let 


r  {l  -  K^/2[(m  ♦  n)r  -  2]}  -  1  -  K^/2(m  -  1). 


A  -  A(m,  a)  -  1  -  K^/2(m  -  1), 
Then  solving  (1)  for  the  appropriate  root  yields 


r  - 


2  ♦  (m  ♦  n) A  ♦  K^/2  ♦  ♦  (m  ♦  n)A  ♦  K^/2]  -  8(m  ♦  n)A 


Thus  tha  powar  efficiency  of  Scheffe's  ono-eided  t-taat  solution  to  the  Behrens-Fisher  problem, 
for  tha  case  in  tftich  tha  ratio  of  tha  variances  ia  also  known,  is  approximately  equal  to 

T 


(2) 


50 

(»  ♦  n) 


— - 2 

2  ♦  (m  ♦  n)A  ♦  K^/2  ♦  ^{2  ♦  («  ♦  n)A  ♦  K^/2]  -  8(a  ♦  n 


)A 


for  suitable  values  of  a  and  o. 
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